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Abstract. The smooth function reconstruction needs to use derivatives. 
In 2010, we used the gradually varied derivatives to successfully con- 
structed smooth surfaces for real data. We also briefly explained why 
the gradually varied derivatives are needed. In the this paper, we present 
more reasons to enlighten that forcing derivatives to be continuous is 
necessary. This requirement seems not a must in theory for functions in 
continuous space, but it is truly important in function reconstruction for 
real problems. This paper is also to extend the meaning of the method- 
ology for gradually varied derivatives to general purposes by considering 
forcing calculated derivatives to be "continuous" or gradually varied. 

1 Introduction 

In smooth data reconstruction, derivative computation is a essential task. How- 
ever, the accuracy of derivative calculation is often omitted in most of applica- 
tions. In this paper, we give some examples to show the importance of obtaining 
continuous derivatives. And we will discuss the methods to make or force the 
calculated derivatives to be continuous. 

For a given sample point, the derivatives only affect its neighbor points not 
itself. When two sample points are relatively apart from each other, the deriva- 



2 



L. M. Chen 



tives up to m-order will not change the value at the sample points. Therefore, 
wc can make continuous derivatives at the sample points to any degree without 
changing the value at the sample points. 

We conclude that we must force a " continuous" derivatives before it is used. 
And such continuous must based on the definition of the space we are dealing 
with not just assume the continuous one in i?". This is because that there are 
always continuous interpolation from finite samples to Euclidean space. We can 
use gradually varied function |2I3I10) . piecewise linear, or the special type of 
Lipschitz functions to restrict the meaning of continuity. 

2 Numerical Derivative Calculation and Finite Difference 
Methods 

In numerical mathematics, the most common method for derivatives is the fi- 
nite difference method. The other methods some times use the idea of finite 
differences. 

Let Ax be a small constant, then 



Af = f{x + Ax) - f{x) 



(1) 



We have 
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Af _ fix + Ax) - fix) 
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Furthermore, 
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where: 



A^f = AiAf) = fix + Ax) - 2fix) + fix - Ax) (4) 
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The finite difference metfiod may generate large error in calculating deriva- 
tives depends on the resolution of decomposition of the function or space. 

We choose the following example to see the performance of a sampled function 
in discrete space: f{i) = ( — 1)*. This function is a sequence of /(O) = 1, /(I) = 
-1, 1, -1..., 1, -1, .... The first order derivative of / is /'(O) = -2, 2, -2, 2, .... 
Thus, = 2* . 

This is the worst case. We also can let /(O) = L,f{l) = —L,L,—L...,L, 
Then we will have / = 2* * L . (If we consider this function is Lipschitz [Tl] , the 
Lipschitz constant is 2L.) 

Does the original function just have such an m-order derivatives? It also 
depends on the sampling ratio beyond the original function. For instance, Cos{x) 
is such a function if we make samples like Cos{i * it). However, (Cos(x))' < 1 
for all X. If we use the difference formula above to do a calculation, it must be 
wrong. 

The better sampling for Cos(x) is 1,0,-1, 0,1, 0,-1, and 1, a, 0, —a, —1, —a, 0, 
a, 1, a, 0, —a, —1, —a..., where a = Cos{'k / A). One might say that we can do fine 
sampling, and there is a sampling (ratio) theorem. However, in general applica- 
tion, we do not know the periodical cycles. 

3 Methods for Continuity-Forcing of Derivatives 

In this section, we propose to use three methods for making continuous if the 
derivatives are not "continuous." In discrete space, continuity means gradually 
variation TIF or local Lipschitz with limited Lipschitz constant locally. 

3.1 Method A: Gradually Varied Derivatives 

Let J be a subset of domain D and / be the function from J to {yli,...,A„} 
where Ai < ... < An. GVF{f) is a gradually varied extension on D. GVF{f) 
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could have two meanings: (1) / is already on D, [J — D), GVF(f) is a gradually 
varied uniform approximation of /. (2) GVF[f) is gradually varied interpolation 
on D. 

Let g = = GVF{f). g' » ^. Since Ax = 1, so g' » Ag. We can just 
use g' = {GVF{f)y for simplification. Thus, F' = (g)' = so 

= GVF{g') = GVF{{F^°'^y) = GVF{GVF'{f)) 

Define 

GT/FW(i^(o)) = GVF{{GVF''-\F")y) = GVF{GVF''-\F°)y . 

is an approximation of i^^*^', the fcth-order of derivatives that 
is also continuous (the fcth-order continuous derivatives). 

In calculus, the Taylor expansion theorem states: A differentiable function / 
around a point xq can be represented by a polynomial composed by the deriva- 
tives at the given point xq- The one variable formula is as follows: 



fix) = fixo) + f'{xo){x - xo) + - xof + ■■■+ 

i^(x - xo)'= + i?fc(a;)(x - xo)^ 

where lima;-,.^;^ Rk{x) = 0. The polynomial in (5) is called the Taylor polynomial 
or Taylor series. Rk{x) is called the residual. This theorem provides us with a 
theoretical foundation of finding the fc-th order derivatives at point xq since we 
can restore the functions around xq. 

After the different derivatives are obtained, we can use Taylor expansion 
to update the value of the gradually varied fitted function (at C*^). In fact, in 
any order C'^, we can update the function using a higher order of derivatives as 
discussed in the above section. For an m-dimensional space, the Taylor expansion 
has the following generalized form expanding at the point (ai, . . . , afe): 
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fi-i^---,-^)=l^---l^ ^^tt::;^;] [o^^frTTTox^ 

m— rik—O ^ ^ ^ 

(6) 

For a function with two variables, x and y, the Taylor series of the second order 
at expanding point (xo,?/o) is: 



f{x,y) ~ f{xo,yo) + {x - xq) ■ fx{xo,yo) + {y - yo) ■ fy{xo,yo)+ 

jj[{x - xo)^ • fxx{xo,yo) + 2{x - xo){y ~ yo) ■ fxy{xo,yo)+ C^) 

(y - yof ■ fyy{xo,yo),] 

There are several ways to implement this formula. For simplicity, we use G{x) 
for GVF{x). For smooth gradually varied surface applications, /(xq, yo), fx, and 
/.are G(/), G(i)(/), etc. 



f{x,y) sa G{xQ,yQ) + {x ~ xq) ■ Gx{xo,yo) + {y - yo) ■ Gy{xo,yo)+ 

ji[{x ~ xo)'^ ■ Gxx{xo,yo) + 2{x - xo){y - yo) ■ Gxy{xo,ya)+ (8) 
{y - yo)^ • Gyy{xo,yo),] 

The above formula shows the principle of digital-discrete reconstruction |10] . 



3.2 Method B: Derivatives Calculation by Normals on Meshed 
Manifolds 

Another common method for derivative calculation is to use normals. This 
method is particularly used in computer graphics in computing derivatives on 
meshes. After the derivatives are calculated on sample points, we will make the 
piecewise linear interpolation on the sample points. So we get a piecewise linear 
derivatives. We call this method the triangulated Derivatives. 
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The method for vertex (normahzed) normal calculation for triangulated meshes. 
This method will do an average of the normals at each triangle around the given 
point. Then, the final value will be normalized as the normal of the point. 

We use the normal to get partial derivatives at (sample) points. For in- 
stance, for a surface z = f(x,y), the normal vector at a point (a;o,yo) is n = 
ifxixoyyo)^ fy{x(),y()), After that, the most important step is to fit the 
derivatives to be gradually varied or "continuous." A gradually varied derivatives 
are necessary for further use. Lastly, we can have up to k number of (directional) 
derivatives and then use the Taylor expansion to get the value surrounding the 
sample points. Again, this idea is the same as Chen's paper in 2010 [TI] . 

In general, given m sample points in 3D (or higher dimension), we want to 
get a smooth surface passing those points. We can first get the piece-wise linear 
surface by using triangulation. So we will have a continue interpolation on those 
points. 

Given a three-dimensional surface, for a implicit form F(x,y,z) = 0, n = 
{'^F)/iVlFx + Py + Fz))- We win have m normals rii for m sample points. 
Then use the m vectors in 3D (or higher) spaces to do another triangulation, we 
will have piece- wise linear function on rii. This function is the source of the first 
order partial derivatives of F . 

Another method for the normal and directional derivatives on surfaces is 
to use 6 nearest points to fit a quadratic equation for local surface, f{x,y) = 
qq + aix + a2y + a-^xy + a^x"^ + a^y'^ , then we can get the normal and directional 
derivatives for triangles, any other shapes of meshes, or mesh-free cases. Again, 
we shall calculate gradually varied derivatives for this. Use the same method 
above, so we can get the derivatives for Taylor expansions. 
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It is also true that we can use the graduahy varied function on manifolds 
to fit the derivative functions when the derivatives on sample points are calcu- 
lated [TTTTB] . 

we have used normals as the concept in 1990 to explain how A-connected 
method works. 

3.3 Method C: Lipschitz Extension of Derivatives 

This suggested method is to use Lipschitz extension to get a Lipschitz function. 
At the sample points, we calculate derivatives then use the Lipschitz extension on 
the derivatives at sample data location to get a Lipschitz derivative functions. 
Next to use Taylor expansions to obtain the whole function extension. This 
method is very similar to Method A. 

For a Lipschitz function, Lipschitz continuous is not an obvious reasonable 
method for construction if the Lipschitz constant does not have a restriction, the 
way is to find a Lipschitz construction then the higher order of derivatives will 
have less (or equal at most) Lipschitz constant. Lip^ < Lip^^^ /2 with the same 
decomposition (resolution in grid or triangulation) is very reasonable selection. 

The key to the above three methods is to always use first order derivatives 
with the adjustment in its own function. We do not use the second order or higher 
difference equations. The advantage is not to transfer the errors of difference to 
higher order. In other words, difference method is not always trustable in higher 
order. 

4 Discussion: The Difference From Other Techniques 

Finding continuous derivatives has been investigated by MUer and others jl6ll7j . 
Their technique is to preserve calculated derivatives to be continuous. Our 
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method is to force the derivatives to be continuous when the derivatives are 
not continuous. 

These two methods have philosophical difference in theory and practice. 
Moller's work is a specific technique. One can ask: how to obtain a general 
method for most of cases when the function formula is not known? 

Our method is a general method for most of cases when sample points are 
provided. We construct the derivative points in the function, then make them 
to be continuous. That is the difference. 

On the other hand, a popular method called subdivision method for smooth 
function reconstruction in graphics pi. The final function is C*^^^ or C^^\ Since 
this method is not designed for data reconstruction, the shape of the final func- 
tion must be designed. Without dense sample points, the result of the method 
is unknown. However, our method presented in the above sections has fitted all 
reasonable data points on every point in the manifold. Those points are now 
perfect as the sample points for the second level of fitting- using subdivision 
methods. We are working on the implementation of this part. We believed that 
we would obtain very good results by keeping the original sample points un- 
changed (the method in 2D is sometimes called 4 point interpolation). The key 
is to add some points around the corner or ridge to make the surface repeatedly 
smoother . 

Moving least square methods can also be applied. Moving least square is a 
mesh-free method 15 . There is no need to partition the domain. It uses a normal 
distribution like function to weight the sample data for a local polynomial fitting. 
The fitting is followed by the principle of the least square. While we move from 
one point to another, the method will fit a new value to the current point. 
This method must rely on the dense sample points with a balanced distribution. 
There may be no points near the fitting point. In another situation, there may 
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be many points around a fitting point. How do we select a weight equation? 
Tlie disadvantage of this method is that we need some knowledge for the weight 
equation, the lengths of circles for the weight changes. An artificial intelligence 
method may be needed for this determination. The process of our harmonic data 
reconstruction will provide the first good fitted data. If we want to use a local 
polynomial to fit the data again, we can use moving least square methods at the 
top of our algorithm. 

Smooth gradually varied functions use gradually varied derivatives and the 
Taylor expansion for the function reconstruction. Gradually varied derivatives 
are needed because finite difference might not get continuous derivatives. Using 
gradually varied fitting on the derivatives is necessary in such a case. In 
we presented this method for a 2D rectangle domain. For 2D manifolds, the 
calculation of derivatives cannot just use finite difference methods. We can use 
Method B to solve the problem. 
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